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ABSTRACT 


Digital  filtering  architectures  that  simultaneously  offer  advantages  for  VLSI  fabrication  and 
contain  distributed  error-control  are  presented.  Such  structures  require  parallelism  as  well  as 
inherent  error-control  capabilities  because  VLSI  implementations  are  susceptible  to  temporary  and 
intermittent  hardware  errors.  Three  different  approaches  have  been  developed  to  meet  these 
requirements.  The  fu-st  method  uses  arithmetic  decomposition  to  obtain  highly  parallel  sections 
each  operating  with  finite  field  arithmetic  while  the  other  two  approaches  concern  finite  and  infinite 
convolutions  over  real  or  complex  number  arithmetic  domains. 

Straightforward  realizations  depending  on  highly  parallel  algebraic  decompositions  were 
studied  first.  They  involve  the  interconnection  of  fault-tolerant  subsystems  employing  finite  field 
arithmetic  into  which  powerful  cyclic  error-correcting  codes  are  imbedded  naturally.  The  locations 
for  fault-tolerance  and  the  role  of  cyclic  codes  are  detailed.  Alternative  realizations  employing  finite 
field  transform  domains  and  new  techniques  for  protecting  the  transform  coefficients  are 
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developed.  These  coefficients'  special  property,  called  the  chord  property,  permits  error  detection 
and  correction  in  the  transform  domain,  and  the  proper  selection  of  certain  code  parameters  can 
enhance  this  capability.  Fast  transform  algorithms  with  distributed  error-control  are  possible 
because  the  interstage  variables  obey  limited  chord  properties. 

Fault-tolerance  at  the  system  level  in  convolution  calcinations  is  now  possible  with  recently 
developed  generalized  cyclic  codes  defined  over  the  rings  and  fields  commonly  employed  for  these 
calculations.  Modem  high-speed  convolvers  use  sophisticated  arithmetic  units  operating  over  large 
finite  integer  rings  or  with  floating  point  approximations  to  the  real  or  complex  field.  Error  control 
is  attached  directly  to  the  data  permitting  protection  of  any  form  of  parallel  or  distributed  system 
configuration.  New  systematic  encoding  and  data  manipulation  techniques  make  error  detection 
with  generalized  cyclic  codes  straightforward  and  efficient.  The  necessary  overhead  parity 
computations  have  complexity  proportional  to  the  number  of  parity  symbols  squared,  whereas  the 
error-detecting  capability  for  both  random  and  burst  errors  is  directly  related  to  this  parity  number. 
Numerical  error  effects  are  considered  with  regards  to  the  tolerances  necessary  in  the  parity 
calculation  and  comparison  operation. 

Infinite  convolutions  are  protected  using  the  error-detecting  capability  of  real  convolutional 
codes.  The  normal  convolution  operation  is  surrounded  with  parallel  parity  channels,  and 
erroneous  behavior  is  detected  by  externally  comparing  the  calculated  and  recalculated  parity 
samples  thus  eliminating  any  degradation  in  high-speed  operation.  A  rate  (k/n)  real  convolutional 
code  produces  (n-k)  parity  samples  for  every  k  filter  samples  causing  the  parity  channels  to  operate 
at  a  rate  decimated  by  k.  Significant  complexity  reductions  are  possible  by  modifying  the  code 
structure,  without  loss  of  error  protection,  yielding  simplified  parity  channels  with  finite  impulse 
response  (FIR)  structures  operating  at  rate  decimated  by  k. 

A  statistical  analysis  of  the  modified  code's  error-detection  comparator  outputs  provides  an 
understanding  of  its  threshold  requirements  and  permits  a  bound  on  the  comparator’s  noise 
variance.  The  new  method  involving  real  convolutional  codes  is  contrasted  with  another 
previously  proposed  method  which  uses  a  block  code  for  the  states  and  output  in  a  digital  filter's 
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state-vanable  realization.  A  panty  comparison  is  required  every  sample  instant  and  in  general  the 


convolutional  code  approach  is  more  efficient  and  flexible. 
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INTRODUCTION 

As  digital  electronic  implementations  of  arithmetic  units  become  more  dense  through 
shrinking  VLSI  technology  and  as  their  speed  of  opteration  increases,  fault-tolerance  will  be  needed 
within  arithmetic  systems.  The  VLSI  revolution  has  produced  cheap,  very  high-speed,  arithmetic 
processors  which  can  momentarily  introduce  errors  in  a  simple  calculation,  a  situation  termed  soft 
errors.  Error  protection  against  such  errors  is  a  critical  requirement.  Erroneous  calculations  must 
be  detected  as  close  to  their  source  as  soon  as  possible  to  avoid  propagating  incorrect  values 
beyond  certain  hardware  and  data  boundaries,  especially  in  distributed  and  parallel  computing 
systems. 

The  work  and  results  have  covered  three  different  approaches  to  signal  processing  system 
design.  The  first  method  employed  a  maximally  parallel  decomposition  of  the  underlying 
arithmetic  domain  so  that  many  individual  processing  sections,  each  operating  over  a  finite  field, 
can  process  data  efficiently  in  parallel.  This  allowed  classical  finite  field  error-correcting  codes  to 


be  incoqwrated  independently  in  each  processing  path.  The  other  two  approaches  viewed  the 
arithmetic  domain  either  as  a  large  finite  ring  or  the  real  or  complex  field.  New,  recently 
developed,  error-correcting  codes  over  these  larger  algebraic  structures  provide  protection  for  finite 
or  infinite  convolutions.  Finite  length  convolutions  are  protected  with  real  cyclic  codes  whereas 
those  with  infinite  length  kernels  rely  upon  real  convolutional  codes. 

The  results  from  each  of  these  three  approaches  will  be  briefly  described  in  the  following 
sections.  The  results  on  the  parallel  arithmetic  decomposition  have  appeared  in  the  open  literature. 
However,  the  newer  results  concerning  applications  of  real  codes  are  still  in  the  publication 
process.  Hence,  two  very  detailed  appendices  are  included  to  fully  document  these  results. 


PARALLEL  DE  COMPOSITIONS 

The  first  work  directly  embedding  data  protection  within  signal  processing  involved  an 
arithmetic  decomposition  of  the  data  samples.  The  Chinese  remainder  theorem  [1]  provided  the 
basis  for  extracting  finite  field  components  from  numerical  samples.  This  approach  distributed 
cyclic  codes,  defined  over  the  respective  finite  fields,  throughout  the  architecture,  greatly 
increasing  the  overall  reliability.  These  architectures  used  simple  arithmetic  and  allowed  powerful 
error-control  features  to  be  built  directly  into  all  the  parts  of  the  system  because  the  inherent 
algebraic  structures  of  error-correcting  codes,  over  general  finite  fields,  match  the  fundamental 
operation  in  filtering  convolution.  Special  structures  associated  with  cyclic  codes  called  minimal 
ideals  have  very  important  algebraic  properties,  not  only  affording  implicit  error  protection  but 
leading  to  fast  maximally  parallel  implementation  algorithms. 

Signal  processing  operations,  after  the  proper  sampling,  scaling,  rounding  and  sequence 
segmentation  are  viewed  as  being  performed  over  a  ring  of  integers  modulo  M  where  M  is  a  large 
positive  integer  [  1  ].  Furthermore  it  is  possible  to  decompose  the  implementation  into  many  parallel 
realizations  by  using  residue  number  system  techniques.  When  the  modulus  M  is  a  product  of 
only  distinct  primes,  the  parallel  decomposition  results  in  subsections  operating  with  finite  field 
arithmetic  requiring  very  simple  arithmetic  processing.  This  situation  is  depicted  in  Figure  1, 
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FINITE  FIELD  ARITHMETIC 
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parallp:l  decomposition  of  processing 

WHEN  MODULUS  CONTAINS  NO  MULTIPLE  PRIMES 

FIGURE  1 


where  each  parallel  subsection  operates  over  the  distinct  finite  fields  denoted  by  GF(pi), 
i=l,2,...,s.  The  arithmetic  decomposition  and  recombination  operations  shown  respectively  at  the 
input  and  output  in  Figure  1  employ  the  Chinese  remainder  theorem.  Three  papers  published  in  the 
open  literature  fully  describe  this  approach  [2-4]. 

The  results  from  this  previous  research  indicated  the  importance  of  treating  data  as 
significant  entities  to  be  protected.  While  the  distributed  finite  field  approach  afforded  adequate 
protection,  its  applicability  was  restricted  and  effects  of  internal  errors  were  difficult  to  predict 
because  of  the  arithmetic  reconstruction  process.  However,  one  outgrowth  of  this  work  was  the 
interrelationship  between  cyclic  codes  and  the  important  convolution  operation. 

FINITE  CONVOLUTIONS 

New  published  research  provided  powerful  cyclic  codes  defined  over  real  numbers  [5].  In 
addition,  similar  codes  over  finite  rings  which  could  be  applied  to  fixed  point  processing  were 
described  in  the  literature  [6].  Concurrently  digital  electronic  technology,  principally  in  the  VLSI 
area,  dictated  that  more  arithmetic  processing  power  for  a  given  area  was  available  and  floating 
point  processors  became  widely  prevalent. 

It  became  possible  to  view  convolution  as  an  operator  on  arrays  of  data,  as  depicted  in 
Figure  2.  and  employ  cyclic  codes  over  the  same  arithmetic  structure  being  used  in  the  underlying 
arithmetic  processors.  The  results  of  this  previous  research  are  detailed  in  Appendix  A  and  they 
were  reported  in  two  International  Conferences  [7,8].  (A  full-length  paper  is  currently  under 
review  for  IEEE  Transactions  on  Acoustics  Speech  and  Signal  Processing  [9].)  The  basic  error¬ 
detecting  approach  computes  parity  samples  affiliated  with  each  array,  producing  the  output  parity 
matching  the  convolution  output.  The  overhead  operations  in  the  parity  recalculations  are  on  the 
order  of  the  number  of  parity  values  squared.  On  the  other  hand,  this  number  of  parity  positions  is 
identical  with  the  error-detecting  capability  of  the  code.  Error  protection  levels  are  a  relatively 
small  fraction  of  long  data  arrays  so  that  the  additional  complexity  is  quite  low.  Hence, 
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any  filtering  or  signal  processing  operations  involving  finite-impulse-response  (FIR)  weighting 
kernels  are  easily  and  efficiently  protected  by  this  method. 

Convolution  with  finite  length  kernels  are  sometimes  implemented  via  fast  Fourier 
transform  algorithms;  the  data  are  transformed,  weighted  by  the  corresponding  transform  of  the 
kernel,  and  the  resulting  component-wise  products  inverse  transformed.  However,  the  overall 
effect  is  cyclic  convolution  wherein  the  finite  length  sequences  are  treated  as  periodically  repeated. 
Unless  padding  zero  values  are  inserted  at  one  end  of  the  sequences  there  will  be  contributions 
from  overlapping  segments.  This  is  called  cyclic  convolution.  Nevertheless  this  only  slightly 
complicates  the  error  protection  method  using  cyclic  codes.  The  end-around  effects  inherent  in 
cyclic  convolution  must  be  separated  and  properly  handled  in  the  parity  channel  calculations.  The 
additional  complexity  is  related  to  number  of  parity  positions  times  the  length  of  the  shortest 
sequence  involved  in  the  convolution.  (See  Appendix  A.) 

INFINITE  CONVOLUTIONS 

Another  widely  used  form  of  signal  processing  employs  input  and  weighting  sequences 
that  are  essentially  infinite.  They  are  usually  realized  with  feedback  paths  and  temporary  storage 
registers,  and  therefore  present  a  different  error  protection  challenge.  Convolutional  codes  are 
well-matched  to  this  form  of  signal  processing.  But  in  a  straightforward  implementation  using 
parallel  parity  channels  which  compute  the  corresponding  parity  values  the  hardware  and  storage 
complexity  are  comparable  to  the  original  realization.  Even  though  the  computational  rates  in  the 
parity  channels  are  slower,  the  net  increase  in  overhead  is  unacceptable.  However,  real 
convolutional  codes  have  extra  degrees  of  freedom  which  permit  significant  simplifications  in  the 
parity  channels  without  reducing  the  error-detecting  capabilities.  (See  Appendix  B.)  The  parity 
computations  and  recalculations  use  FIR  realizations  operating  at  reduced  rates,  lowering  the  error- 
protecting  overhead.  This  approach  is  outlined  in  Figure  3  where  both  parity  channel  groups  have 
effectively  decimated  input  streams  [10].  The  theoretical  basis  for  this  method  of  protecting  infinite 
weighting  signal  processing  is  detailed  in  Appendix  B.  Preliminary  results  were  presented  at  an 
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APPENDIX  A 


PROTECTING  CONVOLUTION-TYPE  ARITHMETIC  ARRAY 
CALCULATIONS  WITH  GENERALIZED  CYCLIC  CODES 

INTRODUCTION 

As  digital  electronic  implementations  of  arithmetic  units  become  more  dense  through  shrinking 
VLSI  technology  and  as  their  speed  of  operation  increases,  fault-tolerance  will  be  needed  within 
arithmetic  systems.  The  VLSI  revolution  has  produced  cheap,  very  high-speed,  arithmetic  processors 
which  can  momentarily  introduce  errors  in  a  simple  calculation,  a  situation  termed  soft  errors.  Error 
protection  against  such  errors  is  a  critical  requirement.  Erroneous  calculations  must  be  detected  as  close 
to  their  source  as  soon  as  possible  to  avoid  propagating  their  effects  beyond  certain  hardware  and  data 
boundaries,  especially  in  distributed  and  parallel  computing  systems. 

High-speed  convolution  of  data  arrays  is  one  common  and  important  class  of  arithmetic 
processing  which  needs  adequate  protection.  Properly  defined  linear  codes  can  protect  the  addition  and 
scaling  of  data  arrays.  However  the  convolution  of  such  arrays  while  constructed  from  there  simple 
operation  require  more  structured  codes.  This  paper  demonstrates  how  generalized  cyclic  codes, 
defined  over  the  rings  and  fields  usually  employed  in  such  processing,  may  be  incorporated  directly  and 
quite  naturally  within  the  implementations  of  such  arithmetic  systems.  The  integrity  of  the  output  data  is  of 
paramount  importance  whether  the  fundamental  operations  are  shared  among  distributed  or  parallel 
processors,  or  concentrated  in  a  single  special  unit.  Furthermore,  new  encoding  and  parity  manipulation 
methods  are  developed  which  permit  straightforward  and  efficient  mechanizations.  Errors  are  detected 
immediately  at  the  conclusion  of  the  processing  pass,  allowing  appropriate  error  control  actions  to  be 
initiated.  Typical  responses  to  detected  errors  may  be  to  retry  the  calculation,  reconfigure  the  overall 
system,  or  enter  a  subsystem  testing  mode. 

The  central  operation  in  signal  processing  or  digital  filtering  is  the  convolution  of  data  sample 
sequences.  These  samples'  arithmetic  values  may  be  viewed  as  algebraic  elements  in  finite  rings  such  as 
the  integers  modulo  an  integer  q,  denoted  by  Zq,  or  as  real  or  complex  numbers,  labeled  respectively  by 
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R  and  C.  Typical  ring  representations  include  two's  complement,  where  q  =  2^  or  one's  complement  with 
q  =  2^-1 .  The  machine  format  can  be  either  fixed  or  floating  point. 


The  fundamental  convolution  operation  may  be  displayed  using  mathematical  symbols,  starling 
from  the  two  data  sequences. 


DATA 

SEQUENCES 


®0’  ^1’ 

^0-  ^-^2 . 


:  a.,  bj,  eZq  or  R  orC 


Their  convolution  involves  the  well-defined  operations  in  the  underlying  ring  or  field. 


j  =  0,1 .2, . . .  ,  (s-Ht). 


(1) 


In  these  defining  equations,  any  sample  with  index  outside  the  prescribed  range  is  considered  to  be  zero. 
See  Figure  1  for  a  schematic  representation  of  the  basic  operation  to  be  protected. 

The  convolution  of  a  kernel  function  with  a  semi-infinite  input  data  stream  may  be  accomplished  by 
several  methods.  Two  popular  ones,  overlap-add  and  overlap-save  [1 ,2],  segment  the  input  data  stream 
into  sections  and  perform  the  required  convolution  with  a  finite  length  kernel,  preserving  pieces  of  the 
resulting  outputs  to  be  recombined  into  a  single  continuous  output  stream.  Nevertheless  the 
fundamental  approach  remains  the  convolution  of  finite  sections  as  described  in  equation  (1). 

A  modern  view  and  the  main  point  of  departure  for  several  recent  texts  [1-3]  considers  these 
sequences  as  polynomials  in  an  indeterminant  X.  Then  convolution  is  intrinsic  in  the  normal  definition  of 
polynomial  products. 

c(X)  =  a(X)b{X) 

where  (2) 

a{X)  =  aQ-Ha.jX  +d.^X  +  .  .  .  +agX  {a^,  a.^, .  .  .  ,  a^} 
b(X)  =  bo+b,X  +b2X^  . . .  -^b,x’«  {b^,  b^ . b,} 

2  s+t 

c(X)  =  Cq+c^X  +C2X  -H .  .  .  +03^, X  ^  {Cq,  c, . c^J 
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CONVOLUTION  OF  ARRAYS 
FIGURE  1 


The  polynomials  in  these  cases  belong  to  an  algebraic  structure,  the  commutative  ring  of  polynomials 
usually  given  the  respective  symbols  Zq[X],  R[X]  and  C[X]. 


Many  fast  signal  processing  algorithms  rely  upon  the  mathematical  properties  arising  from  this 
polynomial  view.  For  example,  when  an  exponent  k  is  chosen  sufficiently  large,  an  equivalent  form  of 
equation  (2)  makes  the  algebraic  structure  even  richer  by  introducing  residue  class  rings  modulo  (X*^-1), 


[1]- 


c(X)  =  a(X)b(X)  modulo  (X*^-1 )  ;  k  >  s+t+1 


(3) 


The  potential  for  protecting  such  operations  with  cyclic  error-correcting  codes  is  obvious  in  light  of  this 
equation.  Cyclic  codes  are  defined  and  manipulated  as  polynomial  residue  algebras,  and  their  common 
fundamental  processing  operation  involves  polynomial  products  [4],  Thus  it  is  natural  to  investigate  cyclic 
codes  as  a  powerful  means  of  detecting  errors  in  these  types  of  operations. 

In  order  to  apply  cyclic  codes  to  the  arithmetic  setting  being  considered  here,  two  hurdles  must  be 
overcome.  Firstly,  most  cyclic  codes  are  defined  over  finite  fields,  primarily  because  their  design  depends 
upon  roots  of  polynomials  in  extension  fields.  Secondly,  and  equally  as  important,  no  previously  known 
data  encoding  format  exists  which  leaves  the  data  symbols  in  their  unaltered  form  while  appending  the 
proper  parity  symbols  when  passed  through  the  polynomial  product  operation.  The  data  and  parity 
positions  become  intermixed  when  processed  this  way.  The  first  difficulty  is  resolved  by  generalized 
cyclic  codes  which  have  been  studied  only  recently  (5,6).  These  types  of  codes  will  be  motivated  and 
detailed  below.  In  addition,  real  cyclic  codes  for  use  with  floating  point  formats  will  be  explained  including 
examples.  The  second  problem  is  solved  by  a  new  systematic  encoding  approach. 


GENERALIZED  CYCLIC  CODES 

Cyclic  codes  represent  a  powerful  and  wide  class  of  codes  with  easily  determined  guaranteed 
distance  properties  that  can  be  used  for  detecting  both  random  and  burst  errors.  They  are  naturally 
defined  in  a  residue  class  ring  of  a  polynomial  algebra  using  the  modulus  (X'^-1),  where  n  is  the  code 
length  [4],  One  feature  guarantees  that  every  cyclic  end-around  shift  of  the  elements  comprising  a  code 
polynomial  is  also  a  code  polynomial,  the  significance  of  the  modulo  (X'^-1)  reduction. 

Generalized  cyclic  codes  will  be  explained  using  a  generic  algebraic  structure  r  which  is  at  least  a 
commutative  ring  with  identity.  Such  a  structure  also  covers  the  fields  of  real  numbers  R  and  complex 


numbers  C.  The  ring  of  polynomials  r(X],  the  set  of  polynomials  in  indeterminant  X,  can  be  reduced  to  a 
residue  class  residue  class  ring  using  (X^-1),  [4],  This  new  structure  is  written  symbolically  as  r(X]/(X^-1). 

A  generalized  cyclic  code  is  defined  by  a  single  generator  polynomial,  g(X),  whose  leading  term  is 
a  unit  in  F.  The  code  is  a  principal  ideal  generated  by  g{X),  denoted  by  ((g(X))),  and  formally  defined  as 

((g(X)))  =  {p(X)  H  q(X)g(X)  modulo  (X"-1 )  :  q(X)er[X]}  (4) 

The  degree  of  g(x)  is  (n-k),  the  number  of  parity  positions  contained  in  the  code.  Construction 
techniques  for  the  generator  polynomial  depend  on  the  exact  nature  of  F.  Nevertheless,  the  Euclidean 
Algorithm  is  a  common  underlying  principle.  It  guarantees  unique  quotients  and  remainders  for  division, 
provided  that  the  highest  indexed  coefficient  in  the  divisor  g(X)  is  a  unit  (invertible)  element  of  F.  Since 
this  general  result  will  be  cited  later,  it  will  be  included  here  |8];  for  any  f(X)EF[X]  there  exist  polynomials 
q(X),  the  quotient,  and  r(X),  the  remainder,  such  that 

f(X)  =  q(X)g(X)  +  r(X)  ;  degree  {r(X)}  <  degree  {g(X)}  (5) 


The  Euclidean  Algorithm  also  shows  the  burst  detecting  capabilities  of  a  cyclic  code.  A  burst  is  a 
consecutive  segment  of  a  code  word's  elements  which  has  the  beginning  and  ending  elements  of  the 
segment  in  error,  and  permitting  any  number  of  erroneous  position  in  between  [7].  Since  the  code  is 
cyclic,  a  burst  can  also  occur  in  an  end-around  sense.  A  burst  can  be  modeled  by  adding  an  error 
polynomial  of  the  form  X^e(X)  to  the  code  word.  However  a  disruption  like  this  can  always  be  detected  as 
long  as  g(X)  does  not  divide  e(X).  (Remember  every  code  word  by  construction  (4)  is  a  multiple  of  g(X), 


and  thus  a  burst  divisible  by  the  generator  polynomial  is  undetectable.)  When  the  polynomial  part,  e(X),  of 


the  burst  error  polynomial  has  degree  less  than  that  of  g(X),  this  division  is  impossible,  providing  the  burst 
detecting  ability  of  (n-k)  positions. 

Cyclic  codes  over  the  real  or  complex  fields  are  defined  by  using  consecutively  indexed  powers  of 
the  n*^  complex  root  of  unity,  e.g.,  [exp(j27r/n)p],  where  j  =  and  p  is  any  integer  modulo  n.  The 
fundamental  construction  techniques  are  given  by  Marshall  [6],  and  use  the  discrete  Fourier  transform 
domain  in  which  contiguously  indexed  transform  coefficients  determine  the  generator  polynomial.  By 
requiring  conjugate  roots  be  included,  real  generator  polynomials  are  constructed.  In  the  more  general 

case  of  complex  numbers,  maximum  distance  separable  codes  [4]  (analagous  to  powerful  Reed-Solomon 
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codes)  are  easily  established.  Such  codes  can  detect  erroneous  positions  equal  in  number  to  the  degree 
of  g{X),  the  maximum  permitted  by  the  Singleton  bound  [4], 


Generalized  cyclic  codes  over  finite  integer  rings,  Zp^,  can  be  defined  by  first  examining  roots  in 

some  extension  field  of  the  finite  field  2p,  p  a  prime  number  [5].  Primitive  elements  in  this  extension  field 
are  studied  as  members  of  a  multiplicative  cyclic  group  in  Zp^-  Again,  consecutively  indexed  roots  and 

their  conjugates  are  used  in  constructing  the  generator  polynomial  with  the  desired  error-detecting 
parameters.  The  most  general  situation  forZg  involves  fields  and  rings  associated  with  the  prime  factors  in 
the  integer  q.  The  Chinese  Remainder  Theorem  [1]  allows  components  over  Zp^  to  be  reassembled, 

defining  a  generator  polynomial  over  Zq.  The  lengths  of  segments  of  adjacently  indexed  roots  guarantee 
the  delecting  performance  of  the  final  code. 

Real  cyclic  codes,  primarily  applicable  to  floating  point  arithmetic  formats  will  be  examined  in 
slightly  more  detail  so  as  to  better  exemplify  the  parity  operations  to  be  discussed  later.  They  are 
constructed  using  consecutively  indexed  primitive  roots  of  unity  [6]  and  were  original  called  Discrete 
Fourier  Transform  (DFT)  codes  [14,15].  Powers  of  the  n**^  complex  root  of  unity,  W,  define  the  roots  of 
the  code  generator  polynomial  g(X). 

9(X)  =  n(x-w'):wi|l 

reR 

R  =  INDEX  SET  OF  CONSECUTIVE  INTEGERS  MOD  n 
Rc  {0,1,2 . ,{n-1)} 

The  span  (number  of  consecutive  indices)  determines  the  error-detecting  capability  of  the  code 
and  is  the  maximum  allowable  for  a  linear  code  [4].  In  this  regard  they  closely  resemble  the  BCH  and  Reed- 
Solomon  codes  defined  over  finite  fields  [4,7],  The  code  can  defect  up  to  |R|  symbol  positions  in  error 
considering  the  roundoff  tolerance  of  the  comparison  operation. 

However  if  the  index  root  set  is  symmetric  about  0  (  and  including  0)  or  about  '^12  (and  including 
^/2  if  n  is  even),  conjugate  root  pairs  appear  in  g(X),  giving  it  real  coefficients.  This  restriction  narrows  the 
range  of  parameters  permitted  in  the  code  slightly  (see  Property  3  of  [6]),  but  does  not  reduce  the  error 
protection  levels  in  any  way.  In  addition,  the  real  coefficients  of  g(X)  are  also  symmetric  or  anti-symmetric 
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about  the  degree  midpoint  halving  the  number  of  multiplicative  operations  needed  in  parity  calculation 
and  re-calculation. 


li 


A  power  of  the  primitive  complex  root,  W^,  where  m  is  relatively  prime  to  n  can  be  used  in  place  of 
W  in  the  definition  of  g(X).  A  different  code  results  with  the  same  error-detecting  capability  but  with  roots 
located  at  more  widely  dispersed  points  on  the  unit  circle.  This  eases  the  accuracy  requirement  in 
calculating  and  using  the  coefficients  in  g(X).  A  simple  example  for  a  code  with  length  n  =  1024  and 
information  capacity  k  =  1003  using  an  index  scaling  factor  m  =  47,  has  capability  of  detecting  up  to  21 
positions  in  error  or  any  burst  up  to  length  21.  Figure  2a  displays  the  generator  polynomial  while  in 
contrast  Figure  2b  shows  the  generator  polynomial  for  the  same  quality  code  but  with  root  index  scaling 
factor  m  =  23.  The  coefficients  in  the  latter  example  are  larger  and  have  a  wider  magnitude  range.  Equally 
good  codes  may  be  centered  about  -1  =  but  they  have  different  coefficient  signs  since  (X-rl)  is  the 
only  linear  factor. 

These  techniques  along  with  others  [9-12]  insure  the  availability  of  a  variety  of  generalized  cyclic 
codes  that  can  provide  a  wide  choice  of  random  and  burst  error-detecting  abilities.  With  the  existence  of 
good  cyclic  codes  over  the  proper  rings  and  fields  established,  the  second  problem  of  efficient  systematic 
encoding  and  parity  manipulation  of  the  code  word  symbols  will  be  addressed. 

SYSTEMATIC  DATA  ENCODING  AND  PARITY  MANIPULATION 

One  important  requirement  of  any  protection  scheme  is  the  location  and  manipulation  of  the 
original  data  and  associated  parity  symbols  without  additional  processing.  There  are  several  methods  for 
encoding  data  code  words  with  this  feature,  generally  referred  to  as  systematic  encoding  [7].  However 
when  two  such  encoded  code  words  are  producted  (to  implement  the  convolution),  the  corresponding 
parity  symbols  are  not  easily  distinguished  except  with  complicated  processing.  This  section  will  first 
demonstrate  a  standard  systematic  encoding  technique  from  which  the  respective  data  and  parity  may  be 
extracted  easily.  Then  a  new  approach  will  be  given  for  processing  and  combining  the  respective  parity 
parts  to  yield  the  new  parity  values  corresponding  to  the  convolved  data  segments. 

A  common  systematic  encoding  scheme  relies  on  the  Euclidean  Algorithm  for  uniquely  defining 
the  parity  positions  [7].  The  data  portion,  say  a(X),  is  placed  in  the  higher  indexed  positions,  by  multiplying 
by  effectively  shifting  to  data  to  inclusively  indexed  positions,  (n-k),  (n-k+1) . (n-1).  The  uniquely 
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Generator  Polynomial  With  Root 
Index  Scaling  m=47. 

Figure  2a. 
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Generator  Polynomial  With  Root 
Index  Scaling  m=23. 

Figure  2b. 


n  =  1024  ;  k  =  1003  . 

REAL  CYCLIC  CODE  GENERATOR  POLYNOMIAL  EXAMPLES 

FIGURE  2 


related  parity  symbols  are  represented  by  the  polynomial  ra(X),  derived  from  equation  (5)  with  g(X)  as  the 
divisor. 

{X"\(X)}  =  q3(X)g(X)  +  ;  deg  rg(X)<deg  g(X)  (6) 

The  code  word  affiliated  with  data  a{X)  is  given  by 

a(X)  [Xn-ka(X)  -  ra(X)] 

A  simple  transposition  in  equation  (6)  shows  that  this  is  indeed  a  multiple  of  g(X),  the  defining  property  of  a 
cyclic  code  word  (see  equation  (4)).  Furthermore  the  parity  values  represented  by  ra(X)  do  not  interfere 

with  the  original  data,  now  shown  as  X'^''<a(X).  in  their  shifted  positions.  A  similar  encoding  also  applies  to 
data  b(X),  where  r^fX)  is  the  unique  remainder  analogous  to  equation  (6). 

b(X)  [X"-kb(X)  -  rJX)] 

The  protection  of  the  convolution  of  two  code  words  is  considered.  If  the  two  respective  code  words  for 
a(X)  and  b(X)  are  producted,  it  is  easy  to  see  the  intermingling  and  overlapping  of  parity  and  data  parts. 
However  the  data  portions  are  easily  extracted  and  producted.  Then  the  question  is:  how  can  the  parity 
parts  ra(X)  and  r^fX)  be  processed  to  yield  the  correct  parity?  In  symbols,  what  relationship  exists  between 
ra(X)  and  r^fX),  and  the  new  parity  rab(X)  related  to  the  product  a(X)b(X)? 

[a(X)b(X)]  {X'^-kIa(X)b(X)]  -  r3b(X)} 

This  new  parity  part  is  the  remainder  in  the  division  by  g(X). 

r^jX}HX"‘W)b(X)]modg(X)  (7) 

The  answer  to  be  demonstrated  in  the  next  paragraph  is  computationally  straightforward. 

r^^(X)Hf(X)rJX)rJX)modg(X)  (8a) 

where 

f(X)  =  x''modg(X)  .  (8b) 

The  validity  of  the  above  claim  revolves  around  showing  that  the  expression  {X'^-*^[a(X)b(X)]-rab{X)}  is  a 
multiple  of  g(X),  modulo  (X'^-l).  In  this  regard  two  identities  need  to  be  compiled.  The  first  comes  from 
equations  (8)  which  imply  that  there  is  a  quotient  qab(X)  satisfying 
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rab(X)  =  X^.OOfbOO  -  q.b(X)9(X) 

The  second  needed  expression  follows  from  the  coded  form  of  b(X),  similar  to  equation  (6),  this  time 
implying  another  quotient  qb(X). 

b(X)  a  x"b(X) »  x''{X"'''b(X))  mod  (X"-1 ) 

=  x''q„(X)g(X)  +  x\(X)  mod  (x"-l ) 

These  identities  when  combined  with  equation  (6)  permit  the  following  series  of  equalities. 

{x"'''[a(X)b(X)]  -  r,;,(X)}  a  [q,(X)g(X)  *  r,(X)][x‘q,(X)g(X)  +  X^^,(X)] 

-|x''r,(X)r,(X)  -  q,|,(X)g(X)l  mod  (x"-1) 

=  g(X){x''q,(X)q,(X)  +  x\(X)r,(X) 

+  x''qJX)rb(X)  +  qat(X))mod(x"-1) 

The  very  constmction  of  rab(X),  equation  (8a),  guarantees  that 

deg  <  deg  g(X)  . 

On  the  other  hand,  the  Euclidean  Algorithm  asserts  a  unique  remainder  polynomial  associated  with  the 
encoding  of  [a(X)b(X)];  equations  (8)  provide  that  polynomial  and  if  has  degree  less  than  (n-k)  also. 

The  use  of  this  systematic  encoding  in  a  fault-tolerant  realization  for  convolving  sequences 
represented  by  a(X)  and  b(X)  is  shown  schematically  in  Figure  3.  The  steps  in  forming  the  new 
systematically  encoded  code  word  are  easily  identified  with  straightfonward  manipulations.  The  protection 
overhead  is  governed  by  the  modulo  g(X)  operations,  which  in  turn  are  proportional  to  the  degree  of  g(X), 
the  number  of  parity  positions  employed  by  the  code.  Even  the  regeneration  of  the  parity  symbols, 
needed  in  the  totally-self  checking  comparator  [13],  depends  on  the  code  generating  polynomial  g(X). 
The  complexity  of  the  modulo  reductions  will  be  discussed  in  the  next  section. 

The  required  parity  calculations  according  to  equations  (8)  may  be  performed  in  several  orders. 
The  modulo  g(X)  reduction  may  be  applied  after  each  product  or  the  complete  product  f(X)ra(X)rb(X)  may 

be  formed,  necessitating  more  storage,  before  the  modulo  reduction  is  done.  Two  options  are  depicted 
in  Figure  4.  The  parity  weighting  factor  f(X),  equation  (8b),  for  the  two  respective  example  generator 
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CODE  WORD  FOR  a(X) 


X"-''  .(X)  -  r.(X) 

1  I 


a(X)  b(X) 


CODE  WORD  FOR  b(X) 


[x"-'‘  b(X)  -  r  JX) 


STORAGE 
f(X)=X‘‘ 
Mod  g(X) 


f(X)r.(X)rjX) 
Mod  g(X) 


RESULTANT  CODE  WORD 


F  ▼  ♦  1 

X'-‘‘.la(X)b(X)}-r.,(X) 

L  1  .  J 


Mod  g(X) 


TOTALLY  Error 

SELF-CHECKING  =o  y.  , 
COMPARATOR  Detection 


USE  OF  SYSTEMATIC  ENCODING  FORMAT 
IN  PROTECTING  CONA^OLUTION  {a(X)b(X)} 

FIGURE  3 


X)  , - ,1«X)  - ; - ^'•.b(X 

(X)r.(X)-,^(X)|— ►|f(X).#(X)-i/<X)  1— ►Hp.(,{X)sV<X)}  Mod  g(X)' 


Products  Followed  By  Modulo  Reduction 

Figure  4a. 


rJX)r^,(X)\=<vX)  Mod  g(X) 


(X)={f(X)a(X)}  Mod  g(X) 


Intermediate  Modulo  Reduction 
Figure  4b. 


ORDER  OF  PARITY  CALCULATIONS 
FIGURE  4 
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PARITY  WEIGHTING  FACTOR  f(X)  EXAMPLES 

FIGURE  5 
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polynomials  given  in  Figure  2  are  shown  in  Figure  5.  They  are  distinguished  by  the  index  scaling  values  of 
47  and  23. 

There  are  situations  where  one  of  the  sequences  to  be  convolved  is  fixed  and  known  in  advance. 


For  example,  b(X)  could  be  the  impulse  response  of  a  digital  filter  [1,2].  The  previous  technique  can  be 
used  to  store  the  known  sequence  and  its  precomputed  parity  positions.  For  a  predetermined  sequence 
represented  by  b(X),  the  stored  positions  correspond  to  the  code  word  {X^'*^b(X)  -  r|3(X)}.  One 
simplification  allows  the  parity  positions  r5(X)  to  be  combined  with  t(X),  equation  (8b),  reducing  the  number 
of  operations  required  for  rgt3(X).  However,  there  is  an  alternate,  equally  effective  method  for  handling  this 
special  circumstance. 

The  known  sequence,  say  b(X),  is  also  stored  in  its  reduced  form  modulo  g(X).  Then  the 
systematically  encoded  code  word  related  to  [a(X)b{X)]  is  given  by 

x"'W)b(X)]  -  r-(X)  , 


where  the  parity  positions  are  defined  uniquely  as 


rn(X)  =  P(X)r  fX)  mod  g{X) 


(12a) 


p(X)  =  b(X)  mod  g(X) 


(12b) 


The  correctness  of  this  approach  is  easily  demonstrated  by  noting  that  equations  (12)  insure  the 
existence  of  a  quotient  qglX)  and  remainder  ro(X)  giving 

P(X)rJX)  =  qg(X)g(X)  +  ro(X)  (13) 

After  cancellation  of  terms,  the  code  representation  for  Ia(X)b(X)]  is  clearly  a  code  word. 


X"'  [a(X)b{X)]  -  ro(X)  Hg(X)[q^(X)  +  q,(X)]  mod  (X  -1) 

Thus  this  abbreviated  method  still  produces  a  code  word,  with  all  the  error  detecting  potential  of  the  code, 
but  with  a  simpler  formula  for  the  parity  portion. 

This  reduced  special  case  occurs  because  only  one  of  the  parity  parts  ra(X)  emanates  from 
X^'*'a(X),  allowing  ease  in  separating  the  effects  of  data  and  parity.  The  slightly  less  complex 
implementation  of  this  method  is  depicted  in  Figure  6.  The  residue  of  the  fixed  sequence  P(X)  is  stored  as 


well  to  expedite  the  parity  formation. 
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Another  situation  of  interest  is  cyclic  convolution  which  is  sometimes  a  byproduct  of  the 
implementation  methods.  For  example.  Fourier  transforms  used  to  form  a  convolution  intrinsically 


€ 
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produces  cyclic  convolution  r2,l6].  Cyclic  convolution  treats  two  sequences  as  periodically  extended  so 
that  any  components  developed  during  the  convolution  process  lying  beyond  the  basic  length  are 
effectively  wrapped  around.  The  polynomial  equivalent  of  length  k  cyclic  convolution  is  described 
through  a  modulo  reduction  using  factor  (X*<-1). 

a(x)b(x)  s  d{x)  mod(x''-1 ) 

The  cyclic  convolution  is  the  remainder  part  in  the  Eucledian  Algorithm  while  the  quotient,  t(x),  will  be 
important  shortly. 

a{x)b(x)  =  t(x)(x'^-1)  +  d(x)  ;  degd(x)<k  (14) 

The  product  a(x)b(x)  represents  the  linear  convolution  which  is  modified  by  shifted  versions  of  f(x)  yielding 
the  cyclic  convolution  d(x). 

d(x)  =  a(x)b(x)  -  xN(x)  +  t(x) 

The  shifted  terms  in  x^t(x)  are  subtracted  from  the  linear  convolution  eliminating  terms  beyond  xk  whereas 
t(x)  is  added  into  the  lower  terms,  the  end-around  effects. 

The  parity  positions  corresponding  to  the  cyclic  convolution  is  r(j(x)  defined  in  an  equation 

reminiscent  of  equation  (6). 

X"’''d(x)  =  q^(x)g(x)  +  r^(x)  mod(x"-1 )  (1 5) 

Previously  given  expressions  for  a(x)  and  b{x)  involving  ra(x)  and  rj3(x)  respectively  may  be  substituted  into 

equation  (14),  expressly  showing  the  dependency  of  c(x)  on  these  parity  parts.  Equation  (15)  then 
relates  there  original  parity  terms  to  the  desired  parity  part  r(j(x)  where  several  simplifications  are  possible 

particularly  because  fo  the  modulo  (X^-1)  reduction. 

-  (X"'''-1)t(x)  -  X^3(x)r^,(x)  = 

{X''[qa(x)qb(x)g(x)  +  rg(x)qj^(x)  +  rjj(x)qJx)]  -  q^(x)}g(x)  (16) 

However  g(x)  divides  (X^-1),  by  the  code's  construction,  permitting  an  identity  modulo  g(x). 
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(17) 


'■d(x)  =  )t(x)  +  xV3(x)r^,(x)  mod  g(x) 

The  new  parity  related  with  cyclic  convolution  d{x)  contains  the  weighted  and  reduced  product  of  the 
inputs’  parities,  as  in  equation  (8a),  and  a  component  involving  the  end-around  modification  t(x)  inherent 
in  cyclic  convolution.  Its  weighting  factor  is  e{x). 

r^(x)  =  e(x)t{x)  +  f(X)rJx)rj^(x)  mod  g(x)  {18a) 

e(x)  =  (X"'^-1)  modg(x)  (18b) 

Thus  the  cyclic  convolution  parity  requires  knowledge  of  the  end-around  terms,  either  directly  or  through 
a  modulo  g(x)  reduced  version. 


COMPLEXITY  OF  PARITY  GENERATION 

There  are  numerous  ways  to  realize  the  convolution  and  modulo  reductions  prescribed  in  the 
previously  described  methods.  They  range  from  distributed  arithmetic  processors  to  time-multiplexing  a 
high-speed  ALU  resource.  In  order  to  study  the  general  complexity,  realizations  as  shown  in  Figure  7  are 
considered.  Both  the  parity  calculation  and  recalculation  operations  involve  reduction  modulo  g(X).  For 
example,  the  (n-k)  parity  positions  represent  the  remainder  after  g(X)  is  divided  into  a  shifted  version  of  the 
information  data,  equation  (6).  Figure  7a  shows  one  viewpoint  of  the  process  using  a  feedback 
configuration.  The  k  data  samples  are  inserted  serially  and  the  remainder  is  developed  by  the  feedback 
paths  effecting  the  polynomial  division. 

On  the  other  hand,  a  slight  modification  of  the  basic  feedback  configuration  computes  the 
product  ra(X)rb(X)  modulo  g(X).  Figure  7b  depicts  such  a  system  where  the  parity  values  in  ra(X)  represent 

the  inputs.  Furthermore  the  output  from  this  system  can  be  passed  through  a  similar  configuration  where 
the  input  scaling  taps  are  defined  by  f(x)  to  produce  the  parity  calculation  dictated  by  equation  {8a). 

These  basic  principles  are  central  to  all  other  configures  including  a  wide  range  of  distributed  and 
parallel  computational  schemes.  Nevertheless  the  polynomial  reduction  process  is  essentially  sequential, 
and  the  viewpoints  in  Figure  7  are  typical  of  the  complexity.  There  are  (n-k)  storage  locations  in  Figure  7 
and  the  leading  coefficient  of  the  code  generating  polynomial  g{X)  is  taken  as  1,  without  loss  of  generality. 
The  lower  portion  of  this  figure  implements  the  product  ra{X)rt){X),  while  the  feedback  path  in  the  upper 

part  performs  and  mod  g(X)  reduction  simultaneously.  As  noted  earlier,  in  real  cyclic  codes  the 
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gn-k-2  W-En-k  1  g(X) 

T  A  FEEDBACK 


Input 

a(X)  HIGHEST  TERMS  FIRST 
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r.(X)  =  ■;x""‘‘  a(X)  1-  Mod  g(X) 
Figure  7a. 
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coefficients  of  g(X)  have  symmetric  or  anti-symmetric  properties  about  the  midpoint.  The  number  of 
multiplications  in  the  feedback  path  can  be  halved  approximately.  This  property,  however,  will  not  be 
assumed  in  the  complexity  estimates  below. 

One  complexity  measure  may  be  a  count  of  the  number  of  multiplications  and  additions  required. 
The  product  part  needs  multiplications  and  additions  on  the  order  of  the  following  estimates. 

[MULTIPLICATIONS:  (n-k)(n-k+1) 

PRODUCT  PART  < 

(^ADDITIONS;  (n-k)(n-k-1) 

On  the  other  hand,  the  modulo  reduction  is  heavily  influenced  not  only  by  the  degree  of  g(X),  but  also  by 
the  number  of  nonzero  coefficients.  The  notation  |g|  will  denote  the  number  of  nonzero  terms  in  g{X), 
including  the  leading  coefficient  presently  assumed  to  be  1 .  Then  the  additional  number  of  multiplications 
and  additions  for  the  feedback  part  may  be  estimated. 

MODULO  [MULTIPLICATIONS:  (n-k-1)(|gl-1) 

REDUCTION  { 

PART  \^ADDITIONS:  (n-k-1)(lg|-1) 

These  estimates  will  be  helpful  in  projecting  the  overall  complexities.  The  are  two  different  approaches 
that  may  be  taken  in  realizing  the  parity  calculations  dictated  by  equation  (8a).  One  approach  would  first 
form  the  triple  product  {f(X)r3(X)r(3(X)],  yielding  a  polynomial  with  possible  highest  degree  3(n-k-l), 

followed  by  the  modulo  reduction.  This  approach  uses  more  interim  memory  locations.  An  alternate 
method  would  interconnect  two  configurations  of  the  type  in  Figure  7b.  With  this  realization  equation  (8a) 
is  implemented  in  two  stages  (see  Figure  4b),  say  first  producing 

a(X)  =  rJX)rj,(X)  mod  g(X)  , 

and  then  completing  the  calculations  with 

r3b(X)H<x(X)f(X)modg(X)  . 

Straightfonward  estimates  show  that  either  approach  employs  on  the  same  respective  orders  of 
multiplications  and  additions. 
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ORDER  OF 

PARITY  GENERATION  < 
COMPLEXITY 


MULTIPLICATIONS:  2[(n-k)  +  (n-k-1)(|g|-1)] 
ADDITIONS:  2(n-k-1  )[(n-k)  +  (|g|-1 )] 


The  dominant  factor  in  both  items  is  (n-k)2,  a  quantity  related  to  the  number  of  parity  positions  in  the  code, 
and  the  error-detecting  ability  of  the  system. 


SUMMARY 

Recently  proposed  generalized  cyclic  codes  defined  over  the  common  arithmetic  structures 
usually  employed  in  practical  data  processing  implementations  dictate  the  parity  samples  for  protecting 
convolution  operations.  The  parity  positions  associated  with  each  input  array  are  convolved  along  with  a 
simply  defined,  comparably  sized,  stored  weighting  array.  A  wide  range  of  quite  powerful  generalized 
cyclic  codes  are  available  with  protection  levels  proportional  to  the  number  of  parity  positions.  The  new 
systematic  encoding  and  processing  techniques  make  the  system  realization  straightforward  and  efficient. 
The  protection  effort  requires  additional  arithmetic  complexity  on  the  order  of  the  number  of  parity 
positions  squared. 
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APPENDIX  B 


PROTECTING  HR  FILTER  REALIZATIONS  WITH 
EMBEDDED  CONVOLUTIONAL  CODES 


INTRODUCTION 

Digital  filter  implementations  need  to  be  protected  against  both  hard  and 
soft  failures  emanating  from  their  underlying  electronic  realizations.  The  level  of 
protection  may  range  from  the  detection  of  erroneous  behavior  to  the  correction  of 
faulty  outputs,  a  situation  sometimes  referred  to  as  error  masking  [l,2].  Many 
protection  mechanisms  rely  on  placing  redundancy,  either  internal  or  external,  in 
the  normal  system  operation,  and  structured  linear  block  or  convolutional  codes 
3.4,  represent  controlled  redundancy  which  can  be  used  for  this  purpose.  Such 
codes  have  their  early  foundation  in  communications  systems  and  are  generally 
defined  over  finite  algebraic  structures  because  of  the  nature  of  digital  communica¬ 
tions.  However,  newer  classes  of  codes  have  been  developed  with  symbols  from 
the  real  or  complex  number  fields  :5j,  the  same  algebraic  setting  for  digital  filter 
realizations. 

This  paper  presents  a  new  method  for  protecting  digital  filters  by  employing 
the  error-detecting  distance  properties  of  real  convolutional  codes.  The  normal 
filter  system  will  be  augmented  with  adjacent  parallel  parity  calculations  whose 
values  are  compared  against  parity  quantities  recalculated  from  the  normal 
system's  output.  Certain  classes  of  errors  occurring  anywhere  in  the  overall  sys¬ 
tem  including  the  parity  calculation  and  recalculation  subsystems  are  easily 
detected.  Furthermore  in  this  way  the  speed  performance  of  the  original  filter’s 
operations  is  not  adversely  affected.  A  convolutional  code  is  ideally  suited  to  the 
fundamentally  infinite  processing  involved  in  Infinite  Impulse  Response  (HR)  filter 
designs.  Because  of  the  inherent  feedback  within  this  type  of  filter  realization, 
errors  can  propagate  and  increase  ultimately  overwhelming  the  protecting  distance 
of  the  code.  This  is  particularly  true  for  block  codes  where  framing  a  large 
number  of  errors  in  one  block  can  easily  exceed  the  code’s  detection  capability. 
On  the  other  hand,  a  convolutional  code  with  its  continuously  increasing  memory 
can  sense  the  onset  of  errors  before  they  increase  beyond  detection  limits. 

k 

A  systematic  real  convolutional  code  [3,5]  of  rate  —  is  applied  externally  to  a 

n 

digital  filter,  producing  (n-k)  parity  samples  for  every  group  of  k  data  samples 
processed  in  the  normal  filter.  A  corresponding  group  of  (n-k)  parity  values  is 
recalculated  from  the  filter’s  output  samples  and  compared  against  the  group  cal¬ 
culated  in  parallel.  Each  group  is  produced  by  parity  filter  channels  operating  at 
a  rate  decimated  by  k  0  . 


Significant  savings  in  the  parity  channels’  complexity  are  achieved  by  modi¬ 
fying  the  real  convolutional  code,  with  minimal  impact  on  its  error-detecting 
capability,  thus  greatly  simplifying  their  implementations.  Equivalent  perfor¬ 
mance  is  possible  with  only  Finite  Impulse  Response  (FIR)  filter  structures  in 
these  parity  channels,  permitting  the  decimation  to  commute  with  the  filters 
themselves  l6i. 

The  theory  and  practice  supporting  the  code  modification  techniques  are  fully 
developed.  An  example  demonstrates  the  general  method.  A  statistical  analysis 
of  the  error  detection  system  guides  the  selection  of  thresholds  at  the  parity  com¬ 
parison  unit,  and  bounds  on  the  comparator’s  output  noise  are  established.  An 
alternative  method  using  block  codes  involving  both  internal  states  and  the  out¬ 
put  at  every  filter  sample  is  analyzed.  This  state  variable  realization  may  be 
viewed  externally  and  compared  with  the  new  convolutional  code  approach  show¬ 
ing  the  latter's  greater  flexibility  and  efficiency. 

The  next  section  develops  the  theoretical  basis  for  embedding  real  convolu¬ 
tional  codes  around  a  digital  filter  system  w'ithout  degrading  the  speed  perfor¬ 
mance.  The  necessary  parity  channel  filters  are  defined  and  described.  The  follow¬ 
ing  section  examines  modifying  the  convolution  code  without  loss  in  error  protect¬ 
ing  performance  while  simultaneously  simplifying  the  parity  channels’  realizations. 
A  practical  approach  to  code  modification  is  presented  where  a  simple  example  is 
detailed.  A  statistical  analysis  of  the  parity  comparator’s  output  noise  is 
developed  and  a  bound  on  its  variance  is  given.  In  the  final  section  an  alternate 
method  which  uses  block  codes  and  a  state-variable  realization  is  examined. 

COW'OLUTIONAL  CODES  IN  FILTER  REALIZATIONS 

General  digital  filters  and  HR  filters  in  particular  may  be  expressed  in  several 
equivalent  ways  with  some  viewpoints  more  similar  to  convolutional  code  struc¬ 
tures  than  others.  The  transfer  function  (pulse  transfer  function)  [7-9]  is  formally 
related  to  a  filter’s  difference  equation  through  the  Z  transform. 

DIFFERENCE  EQUATION 

i  (1) 

1=0  j=l 

n{i)  Input  Sequence 
v{k)  Output  Sequence 
j  .A:  =0,1, 2, . 

The  input  and  output  samples,  u(i)  and  v(i)  respectively,  are  undefined  for  nega¬ 
tive  index  values  (or  assumed  to  be  zero). 
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H(Z)  == 

^  ’  U[Z)' 


wliore  the  components  in  the  ratio  are  Z  transforms  of  the  respective  input  and 
output  sequences.  They  are  related  to  the  difference  equation’s  governing 
coefficients. 


V{Z)  = 

1  =0 

U[Z)  = 

1=0 


H{Z)  = 


+  . 
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(3a) 

(3b) 

(3c) 


The  impulse  response  is  the  inverse  Z  transform  of  H(z)  and  provides  another 
representation  of  the  input /output  relationship. 
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Another  equivalent  expression  for  an  lER  filter  employs  semi-infinite  indexed  vec¬ 
tors  and  matrix. 

u  =  [u(0),  u(l),  u(2), . j 


I/VPC/T  ROW  VECTOR 


i  =  n(0),  n(l),  n(2), 


OUTPUT  ROW  VECTOR 
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ji  =  uF  (5) 

Convolulional  codes  have  a  similar  defining  structure.  Although  traditionally 
defined  over  finite  field  alphabets  [3],  recent  research  results  show  how  they  may 
be  extended  to  systems  using  either  integer  or  real  arithmetic  [5].  Nevertheless, 
the  basic  approach  to  convolutional  codes  remain  the  same,  particularly  with 
regard  to  a  matrix  description  of  the  encoding  and  parity  checking  functions. 
Only  systematic  forms  of  convolutional  codes,  a  situation  where  the  information 
positions  are  clearly  identified  in  the  encoded  output,  will  be  considered  primarily 
because  they  are  well-suited  to  checking  the  filtering  operation  and  are  automati¬ 
cally  noncatastrophic  [3;. 

The  encoding  matrix  for  a  systematic  convolutional  code,  G,  has  a  block-type 
format  involving  rn  fundamental  finite  sized  matrices  whose  dimensions  are 
related  to  the  rate  and  number  of  parity  check  positions  in  the  code.  The  param¬ 
eter  m  determines  the  constraint  length  of  the  code. 
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*  A  catistrophK  convolutional  cod?  permits  a  finite  number  of  errors  to  produce  a  valid  code  sequence  miply- 
ins;  a  ronfur-i^in  with  an  infinite  number  of  errors. 
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Each  subniatrix  C\  is  A'Xn  where  the  ratio  —  is  called  the  rate  of  the  code  and 

n 

(n-k)  is  the  number  of  parity  positions  provided  for  every  k  input  digits.  For  the 
systematic  case,  matrix  G  q  has  a  particularly  distinctive  form. 


Go=  np. 


;  /  k'Kk  Identity  Matrix 
Pq  kX.[n—k)  Parity  —Check  Matrix 


=  OlP, 


;  0  kXk  Zero  Matrix 
Pj  kx(n—k)  Parity —  Check  Matrix 


>=1,2,  .  .  .  ,m. 


The  entries  in  the  parity-check  submatrices,  Pj  are  either  0  or  1  even  for  the 
real  arithmetic  case  [5  .  Encoding  the  input  data  stream,  represented  by  infinite 
row  vector  r,  produces  an  infinite  output  row  vector  2il  with  (n-k)  parity-check 
positions  interleaved  as  a  subblock  between  every  block  of  k  input  values. 


2il  = 


I  Parity  Positions 

u'  (n  +1 ).  .  .  ,  u'  (n  -f  A-  —1).  ic  (  ti  4- A;),  u’  (n  +A:4-l),  .  .  . ,  w  [2n  —l),  w  (2n ),  w  (2/1  +1),  .  .  . 
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Parity  Positions 

....  u.’{sn  +A:),  w{sn  4-A:+l),  .  .  . ,  tr((s-t-l)n  — 1),.  .  .  . 

I - 1 

Parity  Positions 

Tiic  parity  positions  interspersed  between  groups  of  k  input  digits  are  an  effect  of 
the  stacks  of  the  matrices  Gq  G^,  .  .  .  ,G^  in  the  block-shifted  format  evi¬ 

dent  in  C.  In  particular,  the  {k  Xk)  identity  matrix,  I,  part  of  matrix  Gq,  copies 
th('  input  data  from  r  directly  through  to  the  identical  groups  in  2l  ; 


w{sn +j)  =  v{sk+j)  :  s  =0,1,2, .  (9) 

y=0,l,2,...,(A:-l). 

The  parity  positions  are  a  function  of  possibly  (mTl)k  input  samples 
through  the  action  of  the  Pj  parts  of  each  Gy.  The  stack  of  these  parity  weight¬ 
ing  values  will  be  denoted  by  an  {(m -|-l)A:X(n  — A:)}  matrix  Q  with  respective 
columns  'r/,  ] 


P. 


m-l 
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(10a) 


H  -  a 


2i-  =  ((9c  ^  ))  ;  i  =0,1.2 . ,(Tn+l)A:-l.  (10b) 

^{7n-hl)kXl  Column  Vector 

f  =0,1,2.  .  .  .  ,[n-k-\). 


Consequently  generic  parity-check  position  %v(sn-rk-*-r)  is  obtained  by  the  weight¬ 
ing  action  of  column  Each  parity  value  may  be  viewed  as  the  output  of  an 
FIR  filter,  described  notationally  using  the  Z  transform  of  column 

FIR  FILTER  EFFECT.  COLUMN  c. 

(m  -  l)t  - 1 

QAZ)^  ;  c=0,l,2,  .  .  .  ,(n-/:-l).  (11) 

;=0 

When  a  convolutional  code  is  used  to  encode  the  output  of  an  HR  filter  such 
as  the  one  described  by  matrix  F,  equation  (5),  the  combined  effect  in  terms  of 
matrices  becomes: 


ir  =  ulFG  (12) 

The  properly  filtered  data  still  appear  in  the  information  positions  while  the  par¬ 
ity  positions  represent  the  additional  filter  weighting  introduced  by  the  respective 
columns  of  Q,  equations  (10).  The  parity  sample  is  produced  for  every  k  input 

data  samples  corresponding  to  a  decimated  filter  at  rate  —  (6l.  Each  output  of  a 

k 

parity  channel  represents  the  combined  effects  of  the  original  filter  coupled  with 
the  respective  FIR  filter  defined  by  the  Q^Z)  transfer  function;  c=0,l,2,.  .  .  .  , 
(n-k-l).  This  system  dichotomy  is  shown  in  Figure  1  where  HR  filler  matrix  F  is 
denoted  by  its  equivalent  transfer  function  H(Z)  and  the  decimation  action  is  per¬ 
formed  by  the  decimators,  i  k.  Fault-tolerance  is  introduced  by  using  a  detection 
system,  as  depicted  in  F’igure  2  where  the  parity  channel  output  values  are  com- 
jiared  aga'  .st  associated  quantities  calculated  by  similar  parity  weighting  channels 
operating  on  the  output  of  filter  H(Z).  Any  discrepancies,  within  the  round-off 
tolerance  of  the  system  :uid  the  error-detecting  [lower  of  the  code,  indicates  a  pro¬ 
tected  nialfnnction  sonu'where  in  the  system,  includitig  even  the  subsssteins 
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oenerating  or  regeiuTating  tiio  parity  valiu's. 

Of  course,  this  system  configuration  is  grossly  inefficient  since  it  replicates 
(n-k)  actions  of  the  original  filter,  one  in  each  parity  channel.  Even  the  decimated 

sampling  at  reduced  rate  -  does  not  mitigate  the  increased  complexity.  However 

A 

other  steps  can  drastically  reduce  this  complexity  bringing  the  implementation  in 
the  realm  of  practical  applicability. 

SIMPLIFIC  ATION  IN  THE  P.ARITY  CLL\NNT:LS 

One  straightforward  complexity  reduction  method  follows  directly  from  the 
nature  of  the  0  and  1  entries  in  the  FIR  channel  filter  weights.  A  typical  parity 
channel  is  the  cascade  of  the  original  filter,  described  by  its  transfer  function  H(Z), 
with  the  code's  FIR  filter  denoted  generically  by  Q^{Z).  (See  Figure  2  and  equa¬ 
tion  (11)).  On  the  other  h.and,  the  original  transfer  function  is  the  ratio  of  two 
polynomials  N(Z)  and  D(Z). 


n{Z) 


NjZ) 

D{Z) 


[Z  )  =  (I  Q-^o  [Z  ”+  •  •  .  .  Ta,,Z  ' 


I)  [Z)  =  \  -\-h  ^Z  *-(-6oZ  "-f-....  -\-b  f,Z 


(13b) 


o 


'I'he  numerator  function  N(Z)  in  each  paity  channel  may  be  commuted  with 
the  FIR  weighting  Q^[Z)  .  Since  only  every  k  *  output  sample  from  the  parity 
channel  is  required,  the  multiplications  indicated  by  the  numerator  function  N(Z) 
are  performed  only  after  k  samples  have  been  shifted  into  its  implementation. 
Figure  3  displays  a  typical  interchange  for  one  realization  form.  However,  one 
disadvantage  is  tfie  additional  memory  necessary  for  the  feedback  portion  of  the 
altered  cascade,  due  to  the  generally  increased  length  of  the  parity  channel  weight¬ 
ing.  .Normally  the  code’s  constraint  length,  (mq-l)k,  is  larger  than  the  number  of 
filter  poles,  the  degree  i'  of  D(Z).  Even  though  this  additional  storage  is  not  a 
dominating  factor  in  modern  design,  there  are  still  (n-k)  separate  filters,  each  with 
feedback  required. 

The  structure  of  a  convolutional  code  permits  several  degrees  of  freedom  for 
furtfier  simplifying  the  implementation  complexity  in  the  (n-k)  parity  channels. 
The  error  control  capability  of  a  convolutional  code,  even  in  the  case  of  real  arith¬ 
metic  cofles  .  dejjends  primarily  on  the  location  of  the  NONZERO  entries  in  the 
parity  parts  of  tlie  generator  matrix  ;Chapter  10,  3j,  This  translates  into  a  con- 
str.'iiiit  that  the  error- j)rot ('cting  distance  of  a  real  convolutional  code  remains  the 
'-.'iiiic  ri~  long  a"^  the  zero  teriris  in  the  parity  weigmitig  transfer  functions 
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QoiZ).  Qj(/).  .  .  .  ,  Qn-k  preserved  while  permitting  the  nonzero 

values  lo  change,  witliin  acceptable  levels  considering  the  effects  of  roundoff  accu¬ 
racies.  Nevertheless,  all  signs  of  nonzero  entries  in  any  row  of  Q  must  be  the 
same  in  its  modified  form.  The  impact  and  virtue  of  altering  the  parity  weighting 
filters  is  developed  considering  a  generic  parity  channel  transfer  function  Q^(Z). 


M  ={m  +l)k 


'i'he  parity  channel  can  be  simplified  greatly  if  an  equivalent  convolutional 
code  can  be  constructed  so  as  to  eliminate  the  poles  in  the  original  filter.  Label 
the  new  equivalent  parity  weighting  transfer  function  by  Q^.' [Z),  and  then  the 
desired  goals  are  to  select  another  polynomial  R^iZ)  such  that 


D{Z)R,{Z)=Q,'[Z), 

AND 

( 

SET  OF  ZERO  SET  OF  ZERO 
COEFFICIENTS}  =  IcOEFFICIENTS  : 


(15a) 


(15b) 


IN  Q,{Z) 


/A^  Q/{Z) 


Leaving  aside  for  the  moment  questions  concerning  the  existence  and  relative  sizes 
of  the  nonzero  coefficients  in  this  new  Q^' [Z),  the  impact  of  such  a  change,  at 
least  theoretically  is  to  remove  the  feedback  portion  in  each  parity  channel. 

H{Z)Q/{Z)  =  RAZ)N{Z)  =  S,(Z)  (16) 

The  parity  channel  only  needs  to  implement  the  FIR  filter  described  by  the 
transfer  function  S^{Z).  In  addition,  the  decimation  operation,  |  k,  commutes 
with  such  filter  structures  |6],  Figure  4  shows  the  theoretical  impact  of  this 
simplification  for  typical  channel  c  ;  c=0,l,.  .  .  .  ,  n-k-1. 

DESIGN  CONSIDERATIONS 

The  code  modification  process  has  the  potential  for  great  simplification  in  the 
practical  realization  of  protected  digital  filters.  The  general  situation  can  be 
further  constrained  to  permit  only  real  polynomials  in  the  modified  code  design, 
equations  (15).  A  typical  equation  may  be  translated  into  matrix  e<]uation.‘^  with 
real  coeflicients. 
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The  MX{M—b)  matrix  A  represents  the  polynomial  D(Z)  which  when  multiplied 
by  R(Z),  corresponding  to  the  (M-^)  -  rowed  column  vector  r  ,  yields  a  modified 
code  polynomial  Q'  (Z),  denoted  by 

The  row  by  column  products  which  produce  zeros  common  to  both  and 
arc  important  since  they  guarantee  preserved  distance  structure  in  the  real  convo¬ 
lutional  code.  Let  z  be  the  set  of  indices  labeling  the  common  zero  coefficient 
locations  in  ^  and  Q!_-  Assume  that  there  are  E,  items  in  this  set.  A  homogeneous 
system  can  be  constructed  using  only  the  rows  of  A  with  indices  in  z  .  The 
selected  rows  will  be  collected  into  matrix  A  . 


A  r  -Q 


This  homogeneous  system  has  nontrivial  solutions  depending  on  the  relationship  ( 
<  (M  -  ).  Furthermore,  if  p  is  the  rank  of  A  {  with  p  S  s  )>  there  arc  exactly 

(M  -  f  -p  )  linearly  independent  solutions.  These  spanning  solutions  may  be  found 
by  several  standard  methods.  One  approach  changes  A  into  an  upper  echelon 
matrix.  a  matrix  which  has  zeros  in  the  lower  left  triangular  part. 


r  =Q 


^ech  ^sq 


;  A^^  ,  /'X/'i  Upper  Triangular 
B  ,  pX[M  —d—p)  Remaining  Columns 


The  echelon  matrix  may  be  reconfigured  in  turn  since  there  are  (M-  5  -  p  ) 
linearly  independent  solutions,  thus  dividing  a  solution  vector  x  into  dependent 
and  independent  parts  labeled  as  follows: 


Dependent  Part  ^ 


X  = - 


Independent  Part  r 


Equation  (I9a)  may  be  rewritten  in  equivalent  form  using  this  format. 


^  sq  Ul  ^  Jjl 


'I'his  is  easily  solved  by  finding  the  inverse  of  A^^  which  exists  because  it  is  upper 
triangular  due  to  tlie  partitioning  in  ('quation  (tfib). 
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Thus  for  any  set  of  completely  nonzero  real  numbers  Sqi  • 
solution  r_;  can  be  easilv  constructed. 


When  this  parameterized  solution  vector  is  substituted  in  the  original  matrix 
equation  (l7a),  the  modified  weighting  function  4T.  can  be  developed  in  terms  of 
the  independent  variables  Sq  s, . . 


A  r,„i  =  SjL 


The  mathematical  manipulation  package  MACS’^TTA  |lOi  is  ideally  suited  for 
obtaining  the  above  solution  preserving  the  parameterization.  The  variables  may 
be  altered  by  heuristic  rules  to  choose  desirable  convolutional  code  forms.  One 
useful  guideline  is  to  keep  the  relative  magnitudes  of  the  nonzero  coefficients  in  si!_ 
similar.  These  techniques  will  be  exemplified  in  the  following  filter  design  exam¬ 
ple. 

simple  example,  typical  of  most  digital  filter  designs  [pg.  223,  9],  has  four 
poles  and  zeros  with  transfer  function  Hg^{Z). 


_ 0.001836(1  _ 

(1  -  1.49237  +  0.85011  7“^)  (1  -1.56200  +0.64780  ) 


Its  poles  lie  within  the  unit  circle  and  are  listed  as: 


Poles  = 


0.78101  ±y0. 19457 


0.74618  ±j  0.54159 


In  the  interests  of  simplicity,  the  filter  will  be  protected  by  a  six  error-correcting 
majority  logic  decodable  convolutional  code  [Chapter  13  ,  4].  Its  parameters  are 
k  1.  n--2  and  m— 17.  The  single  parity  channel  weighting  filter  has  nonzero 


B  -  12 


coetricieiits  in  positions  0,  2,  7,  13,  16  and  17,  completely  specifying  its  transfer 
function. 

Qi(Z)  =  1  +  +  Z-^'’  (26) 

For  this  example,  M— 18,  f  —  4,  and  the  number  of  zero  terms  in 
s=12.  The  solution  process  yields  a  rank  p  =  12,  leaving  two  indepen¬ 
dent  variables  Sq  >  Sj  to  be  assigned.  An  interactive  choice  of  these  parame¬ 
ters  allows  both  to  be  taken  as  one  and  the  resulting  modified  parity  channel 
weighting  transfer  function  is  Qj' (Z). 

Qi'  (Z)  =  -2.20292 -8.44565^-2 -3.00276  1.01097  ^-1^  (27) 

-  1.74398  -f  0.55074  Z-^^ 

The  corresponding  divisor  polynomial  Ej(Z),  from  equation  (15a),  becomes; 

A\(Z)  =  -2.20292-6.72862  Z-'  -20.56236  Z--  -42.09636  Z-^  (28) 

-61.07129  7-1-77.98817  7-^-78.14788  7-^-66.91630  7-^ 

-  48.82915  7-^-29.29234  Z~^  -  13.01494  Z~^°  -  2.78602  7-1’ 
-l-7-‘2-f 

On  the  other  hand  the  parity  channel  weighting  polynomial  for  the  modified  code, 
.8 1 (7)  is  determined  as; 

Si(7)  =  0.001836  j-2.20292  - 15.54032  7-1 -60.69438  7-2  (29) 

-  173.52920  7-^-384.94830  7-1-675.82958  Z~^ 

-963.47613  Z"^  -  1145.81838  Z~'^  -  1161.40560  Z~^ 

-  1016.68640  7-^-768.97223  7-1°  - 492.83269  7-'i 

-  254.232237-12-93.068227-1^  -  14.15902  7”ii 
+  7.21398  7-1^  +  5  7-1^  +  7-1'^} 

The  code  modification  introduces  coefficient  quantization  errors  in  practical 
irn[)lenientations  i7-9:,  particularly  with  regards  to  the  simplified  parity  channel’s 
error  comparator  subsystem,  typified  in  Figure  4.  Each  comparator  channel  indi¬ 
cates  error  detection  when  the  difference  between  the  parity  channel’s  output  from 
decimated  FIR  filter,  described  by  5^(7),  and  that  recomputed  through  transfer 
function  Q/ [Z }  excei’ds  a  threshold.  I'he  coefficient  quantization  errors 


appearing  at  each  comparator  channel  are  modeled  through  modified  transfer 
functions  representing  the  two  paths  from  the  common  input. 


Q/'{z)  =  g/(/)  +  c,(z) 
5/'(Z)  =  5/(Z)-f//,(Z) 


;  Deg  e,(;f)=(M-l) 

;  Deg  ;/JZ)=  (A/ +/'-(')-!) 


The  transfer  function  Q^' '  [Z)  represents  the  practical  realization  where  the 
quantization  error  effects,  are  small;  S^"  [Z)  corresponds  similarly  to  the 

real  implementation  of  Sf.[Z)  where  small  errors  represented  by  rj^[Z)  are  added 
to  each  coefficient 

The  difference  at  one  comparator’s  output  is  governed  by  an  overall  transfer 
function,  A  (Z).  from  the  common  input.  The  channel  labeling  subscript  c  is 
dropped  for  notational  simplicity  at  this  point,  and  the  effect  of  the  decimated 
sampling  is  denoted  by  |  k. 


A(Z)=  [//(ZMZ)-q(Z)  Jj,  (31) 

d'here  is  an  input  component  at  the  error  detector’s  comparator  output.  The  rela¬ 
tive  magnitude  of  the  input  component  is  important  since  the  error  detection 
mechanism  relies  on  setting  a  threshold.  After  straightforward  manipulation  and 
simplification,  one  detector's  output  samples,  d(s),  at  decimated  sample  times  (tk), 
t— 0.1 . mav  be  given. 


d{tk)  =  V/o'  u{lk-s) 


M  +  c-r-l 

-  V  ii^u{tk-r) 


;  i  =0,1,2, . 


The  first  summation  represents  the  cascaded  filter  H(Z)  e  (Z)  ,  with  impulse 
response  values  hj  ,  while  the  second  summation  corresponds  with  the  filter  r/(Z). 
Since  both  e(Z)  and  //(Z)  have  relatively  small  coefficients,  the  comparator’s  out¬ 
put  samples  are  differences  of  small  values. 

A  statistical  analysis  approach  which  leads  to  a  better  understanding  of  the 
necessary  detector  thresholds  assumes  that  the  input  samples  represent  an 
uncorrelated  input  with  zero  mean  and  variance  rr.  Thus  the  input  samples  u(i) 
obey  the  following  statistical  properties  where  E{  ]  is  the  expectation  operator. 
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£■  1  u(i  )  «(i) }  = 


0 


The  autocorrelation  function  of  one  comparator’s  output,  ,  is  easily  for¬ 

mulated  using  standard  techniques  [7,8j.  The  result  is  nonzero  only  for  zero 
values  of  the  offset  r. 


<:-^^{Tk)  =  E{d[ik)d{{t+T)k))  ;  r=0,l,2,. 


,(rA-)  = 


;'=0 

s=0  1=0  j -0 

;  r^o 


(34b) 


An  upper  bound  on  the  variance  of  the  comparator’s  output  samples  contains 
the  impulse  response  coefficients  of  both  branches  from  the  input  to  the  compara¬ 
tor,  Figure  4. 


M-rl  —  t'-l 

E  (ruf 

1=0 


There  are  well-known  techniques  for  numerically  calculating  the  summed  square 
values  of  the  modified  impulse  response  {h^'  ).  It  was  first  developed  by  Dugre, 
Beex  and  Scharf  [11;  and  is  completely  detailed,  including  a  computer  program  in 
Chapter  5  l7,. 

A  COMPETING  METHOD 

Another  method  proposed  in  the  literature  [12]  applies  specifically  to  a  state- 
variable  based  realization  of  a  digital  filter.  The  next  state  and  output  mappings 
are  encoded  with  a  suitable  real  block  code  at  each  computational  step.  This  pro¬ 
tection  technique  will  be  contrasted  with  the  convolutional  code  approach  just 
developed.  The  internal  effect  of  the  block  code  must  be  reflected  to  the  output  in 
order  to  see  the  implications  of  the  coded  state-variable  method. 


mms 


A  digital  filter  implemented  in  state-variable  form  may  be  described  through 
the  linear  mappings  of  the  next  state  and  the  output  equations.  The  state  size 
will  be  denoted  bv  A 


.\EXr  STATE 
EQUA  TIGS 


OUTPUT 
EQUA  TIGS 


=  A  x{j)  +  B  u{j) 

J  =0,1,2,. 


v{j)  =  C  z{j)  +  d  u{j) 


(.3Gb) 


The  labeling  and  respective  sizes  of  the  vectors  and  matrices  are  summarized 
below. 


INPUT  SAMPLE  u 

OUTPUT  SAMPLE  v\ 
STATE  VECTOR  z\ 

STATE  MATRIX  A 

INPUT  MATRIX  B 

OUTPUT  MATRIX  C 
INPUT  WEIGHTING  c 


w(i) 

z{j)  (<^xi) 

A  {dXQ 

B  ((3X1) 

C  (IX.^) 

t  (1X1) 


The  complete  system  description  may  be  combined  into  one  matrix  equation 
involving  partitioned  vectors  and  a  matrix.  An  aggregate  vector  constructed  from 
the  next  state  vector  i(j  -t-l)  and  the  present  output  v(j)  is  a  linear  function  of 
another  partitioned  vector  containing  the  present  state  z{j)  and  present  input 

u(j)- 

U(j+i)l  U  U(j)] 


The  filter’s  internal  operation  is  protected  by  encoding  the  ((3-|-l)  components 
in  the  aggregate  vector.  The  code  is  defined  through  a  parity-check  matrix  H 
establishing  t  parity  values  to  be  appended  as  additional  rows  on  the  left  side  of 
equation  (37).  The  systematic  form  of  the  parity-check  matrix  displays  t  nonzero 
real  row  vectors,  generically  labeled  ,  each  with  (<3  +1)  elements  while  the  nega¬ 
tive  of  the  identity  matrix,  Q  ,  appears  on  the  right  part  of  the  partitioned  matrix 


PARITY - 
CHECK  I!  = 

1  TRJX  I 

El 

The  partitioned  vector  on  tlie  left  side  of  equation  (37)  is  encoded  by  appending  t 
parity  positions  contained  in  a  parity-check  vector 

'■1(7) 

’'2U) 

l(j)  =  -  (39a) 

where  each  component  comes  from  a  vector  inner  product  with  parity-check  rows 
from  H, 

^(7+1) 

^(j  )  =  Pi_  ;  f=l,2,  .  .  . (39b) 

The  theory  in  Corollary  1  Il2.  demonstrates  that  equivalently  each  column  of 
the  partitioned  matrix  on  the  right  of  equation  (37)  may  be  encoded  producing  t 
parity  defined  position  at  the  bottom  of  each  column.  The  system  equation  for 
the  internally  encoded  digital  filter  contains  a  [  < X('^^-f-l))  matrix,  S,  representing 
the  respective  column  encodings  just  outlined. 

i(j+l)  A 

vU^_  = _ c 

x(;) 

.A  system  configuration  incorporating  an  error-detection  comparator  subsys¬ 
tem  is  shown  in  Figure  5.  The  elements  in  rLlj)  are  the  recomputed  parity  sam¬ 
ples  which  sliould  correspond  with  similarly  indexed  elements  generated  a.s  part  of 
expanded  imatrix  equation  (-10).  It  is  instructive  to  examine  the  outputs  related  to 
parity  sam[)les  in  either  L{j)  or  r_!Ji).  Without  lose  of  generality,  assume  that 


(38) 


the  beginning  initial  state  of  the  filter  is  zero.  The  Z  transforms  of  quantities 
related  to  the  parity  samples  associated  with  lower  part  of  equation  ('10)  may  be 
written  using  upper  case  letters  to  signify  Z  transforms  of  corresponding  sample 
sequences  in  (-1UJ. 

\X{Z) 

R{Z)  =  S  (11) 

U{Z) 

However,  the  next-stale  items  are  expressible  through  the  usual  system  transfer 
matrix  which  includc^s  the  poles  and  zero  of  the  original  filter. 

X{A)  =  {Z1  ^A)~^  B  U{Z)  (-12) 

d'lie  desired  relationship  governing  the  overall  system  response  for  the  parity 
samples  follows  by  combining  equations  (41)  and  (42). 

{Z1  -A  B 

B.{Z)=S  U{Z)  (4:1) 

1 

The  right  side  defines  t  separate  parity  filters,  one  for  each  component  Tj[Z)  of 
R{Z). 

7\{Z) 

T.{Z) 


7\{Z) 

The  parallel  filter  viewpoint  of  this  parity  protection  scheme  is  shown  in  Figure  0. 

Several  aspects  of  this  protection  technique  are  noteworthy.  Parity  samples 
arc  calculated  at  each  sample  instant  permitting  no  efficient  decimation.  The 
filter  poles  are  present  in  each  parity  calculation  channel.  Furthermore  the  error 
performance  of  the  code  rests  on  the  Van  der  Monde  nature  of  the  parity-check 
matrix  [12  .  producing  codt's  with  construction  and  distance  properties  analogotis 
to  HCH  codes  .'1, 1  .  In  general  there  are  no  extra  parameters  to  adjust  for  cancel¬ 
ing  poles  in  thi  fjarity  channels’  system  transfer  functions.  The  convolutional 
code  appears  more  flexible  an-'  ellicient. 
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